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Abstract 

A common assumption in the existing network coding literature is that the users are cooperative 
and do not pursue their own interests. However, this assumption can be violated in practice. In this 
paper, we analyze inter-session network coding in a wired network using game theory. We assume that 
the users are selfish and act as strategic players to maximize their own utility, which leads to a resource 
allocation game among users. In particular, we study network coding with strategic users for the well- 
known butterfly network topology where a bottleneck link is shared by several network coding and 
routing flows. We prove the existence of a Nash equilibrium for a wide range of utility functions. We 
also show that the number of Nash equilibria can be large (even infinite) for certain choices of system 
parameters. This is in sharp contrast to a similar game setting with traditional packet forwarding where 
the Nash equilibrium is always unique. We then characterize the worst-case efficiency bounds, i.e., the 
Price-of-Anarchy (PoA), compared to an optimal and cooperative network design. We show that by 
using a novel discriminatory pricing scheme which charges encoded and forwarded packets differently, 
we can improve the PoA in comparison with the case where a single pricing scheme is being used. 
However, regardless of the discriminatory pricing scheme being used, the PoA is still worse than for the 
case when network coding is not applied. This implies that, although inter-session network coding can 
improve performance compared to ordinary routing, it is significantly more sensitive to users' strategic 
behavior. For example, in a butterfly network where the side links have zero cost, the efficiency at 
certain Nash equilibria can be as low as 25%. If the side links have non-zero cost, then the efficiency 
at some Nash equilibria can further reduce to only 20%. These results generalize the well-known result 
of guaranteed 67% worst-case efficiency for traditional packet forwarding networks. 
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I. Introduction 

Since the seminal paper by Ahlswede et al. [1], a rich body of work has been reported on 
how network coding can improve performance in both wired and wireless networks [2]-[5]. 
Network coding can be performed by jointly encoding multiple packets either from the same 
user or from different users. The former is called intra-session network coding [1], [2] while 
the latter is called inter-session network coding [3]-[5]. A common assumption in most network 
coding schemes in the literature is that the users are cooperative and do not pursue their own 
interests. However, this assumption can be violated in practice. Therefore, assuming that the 
users are selfish and strategic, in this paper we ask the following key questions: (a) What is the 
impact of users' strategic behavior on network performance? (b) How does this impact change 
with different pricing schemes that we may potentially choose for each link? 

It is widely accepted that pricing is an effective approach in terms of improving the efficiency 
of network resource allocation, especially in distributed settings. In [6], Kelly et al. showed that 
if users are price takers (i.e., they treat network prices as fixed), efficient resource allocation 
can be achieved by properly setting congestion prices on each of the shared links. Recently, 
Johari et al. studied how the results on efficiency can change in both capacity-constrained [7] 
and capacity-unconstrained [8] networks if users are price anticipators who realize that the price 
is directly impacted by each individual user's behavior. In this case, users play a game with each 
other, and the efficiency of resource allocation is characterized by the Nash equilibrium of the 
game. A key performance metric is the Price-of-Anarchy (PoA), which measures the worst-case 
efficiency loss at a Nash equilibrium due to users' price anticipating behavior. The PoA is equal 
to 1 if there is no efficiency loss. A smaller PoA denotes a higher efficiency loss. Other recent 
work on resource allocation games and the PoA include [9]— [15]. To the best of our knowledge, 
none of the previous works along this line study price anticipation in network coding systems. 

The game theoretic analysis of network coding has received limited attention in the literature, 
e.g., in [16]-[20]. All results in [16]-[20] focus on the case of intra-session network coding, 
whereas we consider inter-session network coding in this paper. In [21], a game theoretic analysis 
for inter-session network coding of unicast flows in a single bottleneck link is considered. It is 
shown that in some classes of two-user networks, it is possible to use a rate allocation mechanism 
to enforce cooperation among users. In this paper, we assume that there are N > 2 users, two 
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of which use network coding while the rest only use routing. This helps us to better understand 
the interaction between network coding and routing flows. In fact, we show that the performance 
degrades when both network coding and routing sessions share the same link. Our results are 
also different from those in [21] since we consider the capacity-unconstrained case instead of 
the capacity-constrained case as in [21]. In fact, due to the focus on the capacity region of the 
network coding scheme, the work in [21] did not consider the impact of the utility functions of 
the users, the cost of the side links, price anticipation, price discrimination, and the PoA. 
The key contributions of this paper are as follows: 

• New problem formulation: We formulate the problem of maximizing the network aggregate 
surplus, i.e., the total utility of all users minus the network cost, for inter-session network 
coding. As far as we know, such a problem has not been studied in the literature before. 

• Innovative pricing schemes: We consider two pricing schemes: non-discriminatory pricing 
and discriminatory pricing. The first one is the traditional approach in networks with routing- 
only users. It charges all packets with the same price. The second pricing scheme is a novel 
generalization of the first one where the encoded and forwarded packets are charged with 
different prices. We show that due to the special properties of network coding, discriminatory 
pricing is more reasonable in terms of reflecting the actual load generated by each user. 

• Characterization of Nash equilibria: We prove that the existence of a Nash equilibrium for 
the formulated game is always guaranteed; however, there can be many (even infinite) Nash 
equilibria in the resource allocation game with inter- session network coding. 

• Calculation of the PoA in a butterfly network with zero-cost side links: We show that, among 
the two aforementioned pricing schemes, a properly chosen discriminatory pricing leads to 
a better PoA compared with the non-discriminatory approach. We also show that the PoA is 
always smaller (i.e., worse) compared with the case without network coding. In particular, 
at certain Nash equilibria, the PoA can be as low as 25%, which is less than the well-known 
result of guaranteed 67% worst-case efficiency in [8] for packet forwarding networks. 

• Calculation of the PoA in a butterfly network with non-zero-cost side links: We further show 
that if the side links in the studied butterfly network topology have non-zero cost, then the 
PoA can further reduce to only 20%. This occurs due to the fact that in this case none of the 
users have an incentive to participate in network coding. This implies that if the users have 
strategic behavior, then it is important to design mechanisms to encourage users to perform 
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network coding; otherwise, we cannot benefit from the advantages of network coding. 
The key results of this paper together with a comparison with the related state-of-the-art results 
without considering network coding in [8] are summarized in Table I. 

The rest of the paper is organized as follows. In Section |Il} we review some recent results 



on resource allocation games with routing. In Section III, we extend those results to the case 
when two users can jointly perform inter-session network coding in a butterfly network where 
the side links have zero cost. We further extend our analysis to the case where the side links 
have non-zero cost in Section [TV]. Conclusions and future work are discussed in Section |VJ The 
key notations we used in this paper are summarized in Table [IlJ 

II. Background: Resource Allocation Game with Routing Flows 

In this section, we consider a resource allocation game in which multiple end-to-end users 
compete to send their packets through a single shared link as in Fig. [T] By construction, no 
inter-session network coding is performed in this case. This is a well-known problem which has 
been widely studied in [6]— [1 1]. Here, we summarize the key results in [8], which present the 
proper terminology and serve as a benchmark for our later discussions. 

In Fig. [TJ a set of users J\f = {1, . . . , N} shares the bottleneck link between nodes 
i and j. All packets that arrive at node i are simply forwarded to node j through link 
For each user n E M, we denote the transmitter and receiver nodes by s n and t n , respectively. 
Let x n denote the transmission rate of user n E J\f. We assume that each user n E M has a 
utility function U n , representing its degree of satisfaction based on its achievable data rate x n . 
On the other hand, the shared link has a cost function C, which depends on the total rate (i.e., 
^2 n£ j^x n ). As in [8]— [10], we make the following common assumptions throughout this paper: 

Assumption 1 (Users' Utility Functions): For each user nEN, the utility function U n (x n ) is 
concave, non-negative, increasing, and differentiable. 

Assumption 2 (Link Cost and Price Functions): There exists a differentiable, convex, and non- 
decreasing function p(q) over q > 0, with p(0) > and p(q) — > oo as q — > oo, such that for 
each q > 0, the cost is modeled as C(q) = f£ p(z) dz. Here, C(q) is convex and non-decreasing. 
In particular, we assume that there exists a > such that p(q) = aq and C(q) = azdz = |g 2 . 
That is, the cost function C(q) is quadratic and the price function p(q) is linear. Notice that 
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linear price functions are the only price functions that satisfy the four well-known axioms of 
rescaling, consistency, additivity, and positivity for cost-sharing systems^] [9], [22]. 

Assumption [T] is often used to model applications with elastic traffic, e.g., for remote file 
transfer using the file transfer protocol (FTP) [6]. Examples of utility functions which satisfy 
Assumption [T] include the well-known class of a-fair utility functions with a E (0,1) [23]. 
Assumption [2] is also a common assumption in the network resource management literature (cf. 
[9], [14], [24]). In practice, the cost function C may reflect the actual cost (e.g., in dollars) of 
transmitting units of data over link or simply the delay that the packets experience over 
link The more the aggregate data on the link, the higher is the average queueing delay. 

Let x = (xi, . . . , xn). Given complete knowledge and centralized control of the network in 
Fig. [T| an efficient rate allocation can be characterized as a solution of the following problem: 

Problem 1 (Surplus Maximization with Routing): 

maximize J2n=i U n ~ C fen=i x «) 
subject to x n > 0, n = 1, . . . , N. 
The objective function in Problem [T] is the network aggregate surplus [25]. Network aggregate 
surplus maximization is a common network design objective (cf. [9], [10], [14], [24]). Clearly, 
Problem [T] is a convex optimization problem. In general, since the utility functions are local 
to the users and are not known to each link, efficient resource allocation can be achieved via 
pricing. Given the rate vector x from the users, the shared link can set a single price 

K x ) = V (EiLi x n) (1) 
for each unit of data rate it carries. Each user n E J\f then pays x n pt,{x) for its data rate x n . 

Next, we analyze how the users determine their rates based on the price set by link [i, j). 
First, assume that the users are price takers, i.e., they do not anticipate the effect of a change of 
their rates on the resulting price. In that case, each user n E M selects its rate x n to maximize 

'The first axiom, i.e., reseating, requires that the prices should be independent of the units of measurement. The second axiom, 
i.e., consistency, requires that two users having the same effect on the cost should face the same price. The third axiom, i.e., 
additivity, requires that if the cost function can be decomposed, then so should the price function. Finally, the fourth axiom, i.e., 
positivity, requires that if the cost is positive, then the price should be at least non-negative. Notice that the last axiom reflects 
a notion of fairness toward the service provider. [22]. 
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its own surplus, i.e., utility minus payment, by solving the following local problem [6]: 



max (U n (x n ) - x n n) =>- x n = U' n (//), (2) 

x n >0 



where U' n ~ l denotes the inverse of the derivative of utility function U n and price p is as in ([1 
From the first fundamental theorem of welfare economics, if each user neftf selects its rate as 
in ([2]), then the network aggregate surplus is maximized at equilibrium [25, p. 326]. 

Next, we consider price anticipating users: each user can anticipate the effect of its selected 
data rate on the resulting price. In this case, each user tieN no longer selects its rate as in ([2]). 
Instead, it strategically selects x n to maximize its surplus given the knowledge that the price 
fJ>(x) is set according to ([I]) and is not fixed. Clearly, the decision made by user n also depends 
on the rates selected by other users, leading to a resource allocation game among all users: 

Game 1 (Resource Allocation Game Among Routing Flows): 

• Players: Users in set M. 

• Strategies: Transmission rates x for all users. 

• Payoffs: P n (x n ; x_ n ) for each user neJV, where 

Pni^m X—n) U n (^X r ij X n p ^} In— l ^n) ? 

and £c_ n denotes the vector of selected data rates for all users other than user n. 

In Game [Tj each user n E M selects its rate x n > to maximize its payoff P n (x n ; ac_ n ). A 
Nash equilibrium of Game [I] is defined as a non-negative rate vector x* = (x*,..., x* N ) such 
that for each user n E J\f, we have P n (x* n ; x*_ n ) > P n (x n ; x*_ n ) for any x n > 0. In a Nash 
equilibrium x*, no user n E J\f can increase its payoff by unilaterally changing its strategy x n . 

Definition 1: Let x s = (xf, . . . , xf^) be an optimal solution for Problem [I] and x* be a Nash 
equilibrium for Game [T] for the same choice of system parameters. The efficiency at Nash 
equilibrium x* is defined as the ratio of the network aggregate surplus at x* to the network 
aggregate surplus at x s : 

E1i^«)-c(e1 1 < 



(3) 



Definition 2: The price-of-anarchy PoA (Game [Q Problem [T| is defined as the worst-case 
efficiency of a Nash equilibrium of Game [T] among all possible selections of system parameters 
(i.e., number of users, utility, cost, and price functions) as long as Assumptions [T] and [2] hold. 
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The following key result is based on [8, Theorem 3]: 

Theorem 1: Suppose Assumptions [TJ and [2] hold, (a) Game [TJ always has a unique Nash 
equilibrium, (b) We have 

2 

PoA (Game ED Problem [TJ = - . (4) 

3 

From Theorem [TJ for any choice of parameters, the network aggregate surplus at a Nash 
equilibrium of Game [T] is guaranteed to be at least | « 67% of the optimal network aggregate 
surplus. Notice that the PoA indicates how bad the network performance can become due to 
strategic behavior of the users. In the rest of this paper, we generalize Theorem[TJto the case where 
some of the users can perform inter-session network coding. We show that such a generalization 
is non-trivial and the results are drastically different from those in Theorem [TJ in several aspects. 

III. Resource Allocation Game with Inter-Session Network Coding and 
Routing Flows: The Case with Zero Costs for Side Links 

In this section, we reformulate Problem [TJ and Game [TJ in a network scenario where a bottleneck 
link is shared not only by routing flows, but also by some inter-session network coding flows. 
We then extend the results in Theorem [TJ according to a new network resource allocation game. 
We show that the new game setting may have multiple Nash equilibria. In addition, the 67% 
efficiency bound in Theorem [TJ is no longer guaranteed. In fact, although the efficiency loss is 
still bounded, the performance at some Nash equilibria is only 25% of the optimal performance. 

A. Problem Formulation 

Consider the modified network model in Fig. [2} The network topology in this figure is called 
a butterfly network in the network coding literature [5], [26]. The network in Fig. [2] is similar 
to the one in Fig. [TJ except that it includes two direct side links (si,tjv) and (sjv, ii). In this 
scenario, the source node of user 1 is located closer to the destination node of user iV than to its 
own destination node (and vice versa). Thus, users 1 and N can perform inter-session network 
coding. In this setting, we can distinguish two different types of users in the system: 

• Network Coding Users: Users 1 and N, who can perform inter-session network coding. 

• Routing Users: Users 2, . . . , N — 1, who cannot perform inter- session network coding. 
Let X\ and Xn denote packets sent from source nodes si and sjy, respectively. Node i can 

encode packets Xi and X N jointly, and then send out the resulting encoded packet, denoted by 
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Xi © X N , towards node j (and from there towards t\ and t N ). Given the remedy data X\ from 
the side link (si,£at) an d the remedy data from the side link (sjv,ti), nodes £jv an d £1 can 
decode the encoded packets that they receive. In fact, in this setting, nodes t\ and tjsi can decode 
both Xi and X N . Clearly, the benefit of network coding is to reduce the traffic load on link 
(thus reducing the cost) while achieving the same data rates compared to the case that no 
network coding is performed. It is worth mentioning that although the network coding scenario in 
Fig. [2] is simple, it is the building block for more general network coding scenarios. For example, 
in [2], [3], [27] the network is modeled as a superposition of several butterfly networks. Thus, 
understanding this model is the key to understand more general networks. Further to Assumptions 
[T] and [2} in this section, we also assume that: 

Assumption 3 (Zero Cost for Side Links): The two side links (si,t N ) and (sN,h) in Fig. [2] 
always have zero cost and impose zero prices. 

For example, if the link cost is used to model the link delay and the side links (si,tjv) an d 
(s/y,ti) have a higher capacity than the shared link then the costs of the side links can 



be neglected. The case where the side links have non-zero cost is studied in Section IV 



For the network in Fig. |2} the network aggregate surplus maximization problem becomes: 
Problem 2 (Surplus Maximization with Network Coding and Zero-Cost Side Links): 

N /N-l 

maximize U n (x n ) — C ( x n +max(xi , xn) 

n=l \n=2 

subject to x n > 0, n = l,...,N. 
Comparing Problems [I] and [2J we can see that the cost term C(J2n=i x n) m Problem [l] is now 
replaced by a new cost term C(J2n=2 x « + max(xi, xjv)). The intuition behind the objective 
function in Problem [2] is as follows. Since x\ and xn are selected independently by users 1 and 
N, in general, we may have x\ 7^ xn- Thus, regardless of the choice of an efficient network 
coding scheme, the intermediate node i can perform network coding only at rate min(xi, x^)- 
Those packets which are not encoded (e.g., at rate X\ — min(xi, x^) if x\ > x^, and at rate 
xn — min(xi, xn) if %i < %n) are simply forwarded, leading to an aggregate rate of Y^l=2 x n + 
max(xi, xn) on link (i, j). Note that if x\ = xn, then all packets from users 1 and N are jointly 
encoded. In fact, this is the case at optimality as the following result suggests: 

Theorem 2: Let x s = (xf, . . . , x N ) be an optimal solution for Problem [2| We have xf 



x 



N ■ 
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The proof of Theorem [2] is given in Appendix |Aj From Theorem [2| users 1 and iV should 
have equal rates at optimality. Notice that since Problem [2] is a convex optimization problem, it 
can be solved in a centralized fashion using convex programming techniques [28]. Distributed 
resource allocation can also be done via pricing as explained next. 

Following the same pricing scheme as in Section |Il} the shared link may apply a single price 
for all (i.e., coded and routed) packets: 

fi(x) = p (j2n=2 x n + max(xi, x N ) j . (5) 

Each user n pays x n fj>(x). However, this leads to double charging for encoded packets. Note that 
each encoded packet includes the data from both users 1 and N. Thus, the single pricing model 
in Q leads to more payment from the users than the actual link cost. This can be avoided by 
price discrimination, i.e., charging the routed and network-coded packets with different prices. 

Let n{x) in ^ denote the price to be charged for routed packets. Under the discriminatory 
pricing scheme, we define another price 5(x) for network coded packets. In general, we have 

5(x) =/3fi(x), (6) 

where 0</3<l is a pricing parameter. If {3 = 1, then there is only a single price. If (3<1, then 
the encoded packets are charged less than the routed packets as they carry more information 
compared to routing packets of the same size. In this paper, we focus on the case of /3 = |. 
This is the only choice of (3 that avoids over- or under-charging with two network coding flows. 
Based on the this pricing scheme, user 1 pays min(xi, xn)S(x) + (xi — min(xi, x^)) fi(x). That 
is, it pays for transmission of its encoded packets at a price of 5(x) and for transmission of its 
forwarded (not coded) packets at a price of p(x). From ([6]), the total payment by user 1 is 

(xi — (1 — (3) min(xi, xn)) p-(x). (7) 
A similar payment model applies to user N. Notice that each user n = 2, . . . , N — 1 pays x n p,(x). 

We are now ready to define a resource allocation game for the network setting in Fig. [2[ when 
users can anticipate prices ji and 5 according to ([5]) and ([6]), respectively: 

Game 2: (Resource Allocation Game with Inter-session Network Coding and Routing Flows 
where the Side Links Have Zero Costs and Zero Prices) 

• Players: Users in set M. 

• Strategies: Transmission rates x for all users. 
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• Payoffs: Q n (x n ; x_ n ) for each user n G TV. The network coding users 1 and N have 

Qi(xi] x-i) = /7i(xi) - (xi - (1 - /3) min(a;i,XAr))p fe^ 1 ^ + max^i, x N ) \ ,; (8) 
Q N (x N ;x- N ) = U N (x N ) - (x N -(l-fi) mm(x 1 ,x N ))p (^2^=2 x r + max(xi, x N ) \ , (9) 
and each routing user n 6 A/"\{1, A 7 "} has 

Qn(x n ; = U n (x n ) - X n p \ J2r=2 X r + max(xi, X N ) j . 

Comparing Games [TJ and [2} we can see that Game [2] introduces significantly more complex 
payoff functions. In the rest of this section, we answer the following questions: 

1) Does Game [2] always (i.e., for any choice of system parameters) have a Nash equilibrium? 

2) If a Nash equilibrium exists for Game [2| is it always unique? 

3) What is the worst-case efficiency (i.e., the PoA) at a Nash equilibrium of Game [2[? 

B. Existence and Non-uniqueness of Nash Equilibria 

A Nash equilibrium of Game [2] with both routing and inter- session network coding flows can 
be defined as a data rate selection vector x* y 0, where the inequality is coordinate-wise, such 
that for all users n E M, we have Q n (x* n ; x*_ n ) > Q n (x n ; x*_ n ) for any choice of x n > 0. 

Theorem 3: There exists at least one Nash equilibrium in Game |2j 

The proof of Theorem [3] is given in Appendix |Bj The key to prove Theorem [3] is to apply 
Rosen's existence theorem for concave N -person games [29, Theorem 1]. In this regard, we show 
that for all users n&N, the payoff function Q n (x n ;x_ n ) is a concave function with respect to 
x n , even though Q 1 and Qn are not differentiable due to the max and min functions. 

From Theorem [3j the existence of Nash equilibria for the resource allocation game is still 



guaranteed when network coding is applied. However, as we will see in Section III-C there can 



multiple Nash equilibria in this case. This can change the results on efficiency loss and the PoA. 

C. Users ' Best Responses 

The strategic behavior of users can be modeled based on their best responses. In this regard, 
each user n G M selects its data rate as xf t to maximize its own payoff Q n , given x_ n : 

a^(cc_ n ) = argmax Q n (x n ;x- n ), Mn e Af. (10) 

x n >0 



Since the problem in (10) is convex, we can readily show the following for routing users. 
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Proposition 1: For each routing user n eJ\f\{l, N}, the best response x^(x„ n ) is obtained 
as the value of x n which satisfies the following equation (bounded below by 0): 

/ N-l \ 

Un( x n) — a I x T + max^xjXjv) J — 2ax n = 0. (11) 

\r=2,r=/=n J 

Recall that the linear pricing parameter a is defined in Assumption [2} The proof of Proposition 
[I] is given in Appendix |Cj The key idea is to take the derivative of the payoff Q n (x n ; X- n ) with 
respect to x n and solve the resulted Karush-Kuhn-Tucker (KKT) optimality condition [28]. 

Obtaining the best response functions for network coding users 1 and N is more complex, 
mostly due to the non-differentiability of the payoff functions Qi(xi;x-i) and Qn(xn',x_ n ). 
In fact, network coding user 1 should separately examine two scenarios: 
(a) Selecting its strategy (data rate) x\ to be greater than or equal to xn- 

xf(x_i) = argmax U\{x\) — {x\ — (1 — (3)xn) a I x n + x\ J . (12) 



x±>x 



1^X N 



,n=2 



(b) Selecting its strategy (data rate) x\ to be less than or equal io x N : 

/JV-l 

x x {x-i) = argmax Ui(xi) — (3xi a \ 2. x n + xn ) ■ (13) 

0<X!<X N ' 



,n=2 



The intuition behind the objective functions in (12) and (13) is as follows. In (12), since the 
strategy of user 1, i.e., its data rate x±, is lower bounded by x^, we have: mm(x 1 ,XN) = x^ and 
max(xi, xn) = x\. Thus, the payoff function Qi{x\\ ac_i) in ^ reduces to the objective function 



in (12). On the other hand, in (13), since the data rate x\ is upper bounded by xn, we have: 

min(xi, Xn) = X\, max(xi, x^) = x^, and x\ — (1 — (3) min(xi, x^) = X\ — (1 — (3)x\ = f3xi. 



Thus, the payoff function Qi(x\] ac_i) in ([8]) reduces to the objective function in (13). 

Given ,xf(£c_i) and xf(x-%), if Qi(xf (x-i); cc_i) > Qi(xf (aj-i); JC-i), then user 1 selects 
its best response a:f (a;_i) = £f (aJ_i); otherwise, it selects xf (cc-i) = x f (sc-i). The best response 
for user is obtained similarly. We can show the following for network coding users. 

Proposition 2: For network coding user 1, the data rate xf (as-i) is obtained as the value of 
Xi that satisfies the following equation (bounded below by x N ) 



f N-l 



U[(xi) — a | x n + x\ J + a(l — /5)xat — axi = 0. (14) 



,n=2 



Furthermore, if the utility function U\{x\) is non-linear, then xf (cc-i) is obtained as the value 
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of X\ that satisfies the following equation (bounded between and x^) 

Ufa) -Pa (^2x n + x N j = 0. (15) 

When the utility function Ui(xi) is linear (i.e., U[(xi) is a constant for all X\ > 0), we have 
xf(x-i)=x N ,ifU[(xi) > (3a(Y^n=2 x n+x N )\ and xf (ac_i) = 0, if L^(xi) < (3a{Y^=2 x u+xn)- 
In this case, if U[{x\) = f3a(J2n=2 x n + x n)> then xf (£C_i) is any value between and x/y 
The proof of Proposition [2]is given in Appendix |D} The key idea is to solve the KKT optimality 



conditions [28] for the optimization problems in ([12]) and (13) for user 1 (and N). We can see 



that the best responses in Propositions [T] and [2] only depend on the first derivatives of the utility 



functions. We will use this key observation to characterize the Nash equilibrium in Section III-D 



D. Nash Equilibrium and Price-of-Anarchy 



Given the best response functions in Section III-C , we are now ready to characterize the Nash 



equilibria. Let X* denote the set of all Nash equilibria of Game [2} Recall that set X* has at 
least one member as shown in Theorem [3} By definition, for any Nash equilibrium x* E X* , 
given x*_ n , the best response for user n E J\f is the same as its strategy at Nash equilibrium 
[30]. That is, x^(x*_ n ) = x* n for all n 6 J\f. Thus, all Nash equilibria of Game [2] can be obtained 
using the best response equations in Propositions [T] and |2j Recall from Section III-C that the 



best responses in ( |T3| ), ( |T5[ ), ( |T5[ ) only depend on the first derivatives of the utility functions. 
Therefore, for each Nash equilibrium x* EX*, if we define the following linear utility functions: 

U n (x n ) = U^(x* n ) x n , Mn E Af, (16) 

then x* continues to be a Nash equilibrium for a new game with new utilities Ui(x%), . . . ,Un(xn)- 
In fact, x* is a Nash equilibrium for the family of games with utility functions Ui(xi), . . . ,Un( x n) 
having their first derivatives equal to U[(xl), . . . , U' N (x* N ) at Nash equilibrium, respectively. 

Theorem 4: For each Nash equilibrium x* E X* of Game [2] and any optimal solution x s of 
Problem [2[ the following inequality holds: 

En=iUnK)-C(j2^ x * n +max(xl,x* N )) Eli^(<)-C'(En=2<+nia X K,^)) 
Eti^M-CfeS^+niax^f,^)) " max q ~>o[crq-C(q)} 

(17) 

where a = max {U' 2 {x* 2 ), . . . , U'^fa^), Ufa) + U' N (x* N )}. 
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The proof of Theorem [4] is given in Appendix [Ej Notice that maxg> [ a q — C(q) ) denotes the 
optimal objective value of Problem [2] for the special case of having linear utility functions (see 
Appendix [E]). Therefore, for the inequality in (17), the right hand side denotes the efficiency for 
linear utility functions while the left hand side denotes the efficiency for any utility functions, 
assuming that the rest of the system parameters (i.e., number of users, cost function, and price 
functions) are the same. This leads us to the following helpful theorem. 

Theorem 5: The worst-case efficiency at a Nash equilibrium of Game [2] with respect to the 
optimal solution of Problem [2] occurs when the utility functions are linear for all users. That is, 

U n (x n ) = 7„x„, Wn E Af, (18) 

where utility parameter 7 n > for all users n E ftf. 

From Theorem |5J to obtain the PoA for Game [2] for arbitrary choices of utility functions 
(as long as they satisfy Assumption [TJ, it is enough to only analyze the case when all utility 
functions are linear. This key observation can make our analysis significantly more tractable. 
Notice that for the case of linear utilities, we have U' n (x n ) = 7 n for all n E M. As a result, the 
best responses for all users can be obtained in closed form using Propositions [T] and [2| 

Next, we obtain the exact value(s) of the Nash equilibrium(s) and PoA for Game [2] 

Theorem 6: Suppose Assumptions [TJ [2j and [3] hold. Also assume that the utility functions are 
linear. Consider the case where N > 2 and let x* denote the Nash equilibrium for Game 2. 
Without loss of generality, assume that 71 > jpf. For notational simplicity, we also define 



N-l 



n=2 



(a) If 7jv < 7i < (l + |) In - paq*, then 



maX ^°'^j|- Il=% - maX l °' Pa >■ (20) 



(b) If (l + 7w - paq* < 7l < | 7JV - aq*, then 



^-a* x* - ^ N - 71 Q - (21) 

(3a g ' Xn ~ a(l-/3) 1-/3' W 



(c) If 71 > §7jv - aq*, then 



x\ = max <j 0, ^ - y }> , x* N = 0. (22) 
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(d) For any choice of system parameters in (a)-(c), the routing users have the following rates^] 

if 7„ < a(q* + x{), 

V 11 n = 2,...,N -1. (23) 

- q* — x\, otherwise, 

The proof of Theorem [6] is given in Appendix [FJ From Theorem [6fa), if the slopes of the 
linear utility functions for users 1 and N (i.e., 71 and 7^) are identical or close, then at Nash 
equilibrium, users 1 and iV choose to have the same data rates and there are infinite Nash 
equilibria. Theorem |6jb) and[6]^c) show that if 71 and ^ N are not close, then users 1 and N will 
choose different rates at the Nash equilibrium. Comparing this with the results in Theorem [2j 
we shall expect a drastic efficiency loss, especially if 71 > |7at— aq* as it results in x* N = 0. We 
also notice that the Nash equilibrium directly depends on the value of the pricing parameter (3. 
To study the properties of Nash equilibria of Game 2, we consider two different cases: 
1) Two Users Case: Consider the butterfly network in Fig. [2] and assume that iV = 2. In 
this case, the network includes two network coding users and no routing users. We can obtain 
the Nash equilibria using Theorem [6] by setting q* = 0. The Nash equilibria when (3 = 1 and 
(3 = I are shown in Fig. j3^a) and (b), respectively. We can see that the data rates at the Nash 
equilibria are always less than the optimal rates, except when 71 = 72 and (3 = |. In addition, 
in many cases (i.e., 71 > 272 for (3 — 1 and 71 > 372 for (3 — |) we have x\ < x\. This leads to 
further deviation from the optimal performance. Recall from Theorem [2] that at optimality, the 
data rates of users 1 and iV should be equal. We can show the following in the two-user case: 

Theorem 7: In a network as in Fig. [2] with N = 2, under the single pricing scheme {(3 = 1), 

PoA (Game Problem |2) = -, (24) 
and under the discriminatory pricing scheme with (3 — |, 

PoA (Game Problem |1 = — . (25) 

25 

The proof of Theorem [7] is given in Appendix [Gj Here, PoA (Game |2j Problem |2]) denotes the 
lowest (i.e., worst-case) ratio of the network aggregate surplus at a Nash equilibrium of Game 

2 Notice that for each routing user n G JV"\{l,iV}, the strategy at Nash equilibrium, i.e., data rate only depends on q* 
and x*, but not x* N . In fact, since we have assumed that 7jv < 71, we indeed have x* N < x{, as shown in j20|l-l|22}. Therefore, 
max(ij,ijj) = x\ and neither the cost function nor the price functions for the shared link depend on data rate x%. 
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[2] to the network aggregate surplus at the optimal solution of Problem |2j Theorem [7] extends the 
results on efficiency bounds for routing flows in Theorem [T] to the case where two inter-session 
network coding users share a link. We can see that even for this simple scenario, the efficiency 
bound in Theorem [T] cannot be guaranteed anymore. From Theorem [7J inter-session network 
coding with no price discrimination can reduce the PoA from 0.67 down to | ~ 0.33. On the 
other hand, even if we use price discrimination by setting /3 — \, i.e., users 1 and N split the 
price of encoded packets, the PoA improves only to || = 0.48. This implies that inter-session 
network coding is significantly more sensitive to strategic users. Thus, unlike the case of routing 
networks, a simple pricing scheme (even with price discrimination) may not be sufficient to 
encourage cooperation in inter-session network coding systems. 

It is worth mentioning that the above results do not imply superiority of routing versus 
network coding. In fact, we can verify that at any Nash equilibrium of Game [2j the network 
surplus is higher than or equal to the network surplus at the Nash equilibrium of Game [T] for 
the same parameters. In other words, non-cooperative network coding results in an absolute 
performance which is no worse than the absolute performance of non-cooperative routing. 
However, the relative performance in non-cooperative network coding compared to optimal 
cooperative network coding is worse than the relative performance in the routing-only case. 

Numerical results on efficiency of the Nash equilibrium of Game [2] for 200 randomly generated 
scenarios with different choices of system parameters in the two-user case are shown in Fig. 
|4j In particular, in each scenario, the utility functions of the users are chosen to be a-fair (cf. 
[23]) with a randomly selected utility parameter a E (0,1). We can see that by using price 
discrimination with parameter (3 — 1, the guaranteed worst-case efficiency bound (i.e., the PoA) 
improves from 0.33 to 0.48. For the rest of this paper, we focus on the case with (3 = \. That 
is, the network coding users split the charge of transmitting their jointly encoded packets. 

2) General Case: Next, consider the case where the topology is as in Fig. [2] and there are 
N > 2 users in the network. The presence of both network coding and routing users makes the 
analysis more complex. To see this, consider the network in Fig. [2] and assume that N = 3, a — 1, 
(3 — |, 71 > 73, 73 = 1, and 72 = 3. In this case, users 1 and 3 are the network coding users 
and user 2 is a routing user. From Theorem [6j the Nash equilibria are obtained as shown in Fig. 
[5] Comparing the results in Fig. [5] with those in Fig. |3j we can see that adding an extra routing 
user forces the network coding users 1 and 3 to reduce their data rates at Nash equilibrium. 
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However, there still exist multiple (infinite) Nash equilibria when 7x and 73 are close. It is easy 
to numerically verify that in this scenario, the worst-case efficiency at Nash equilibrium of Game 
[2] is 46.5%. Comparing this with the results in Theorem [7J we can expect that adding routing 
users will further reduce the PoA. In fact, we can show the next theorem in a general case: 

Theorem 8: Consider a network coding system as in Fig. [2] and assume that N >2. 

(a) If the price discrimination parameter (5 = |, we have 

PoA (Game H Problem © = - . (26) 

(b) The worst-case efficiency occurs when N — > 00. 

The proof of Theorem [8] is given in Appendix |H| Comparing the results in Theorem [8] with 
those in Theorems [T] and |7} we can see that a resource allocation game with both network coding 
and routing users has a worse PoA compared to the routing only and network coding only cases. 

IV. Resource Allocation Game with Inter-Session Network Coding and 
Routing Flows: The Case with Non-zero Costs for Side Links 



In Section III we considered a network coding scenario in a butterfly network where the side 
links have zero cost as stated in Assumption |3j In this section, we study the case where the side 
links have non-zero cost. We show that the results will be noticeably different. In particular, 
the network coding users are no longer interested in participating in network coding. This can 
further reduce the efficiency to as low as only 20% of the optimal network coding performance. 

A. Problem Formulation 

Consider the network in Fig. [6j In this figure, the side link (si,tjv) has price pi and cost C\ 
while the side link (sn, ti) has price pn and cost Cn- Suppose that Assumption [2] also holds for 
the price and cost functions of both side links. In addition, we make the following assumption. 

Assumption 4 (Non-Zero Cost for Side Links): The side links (si,t N ) and (sjv,ti) in Fig. [6] 
always have non-zero cost and impose non-zero prices. In particular, the side link (si,tjv) has 
price pi(vi) = a\V\ for a\ > and the side link (sN,h) has price Pn(vn) = clnVn for > 0. 

Clearly, by sending remedy packets over side link (si, t N ), user 1 is helping user N to decode 
the encoded packets it may receive. However, due to non-zero cost at the side links, user 1 will 
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be charged for sending these remedy packets. A similar statement is true for user N when it 
sends remedy packets on the side link (sN,h). Therefore, users 1 and N may decide to reduce 
the rate at which they send the remedy packets on the side links, compared to the rate at which 
they send their own data packets to node i. In other words, they may decide to have partial or no 
participation in network coding. Users 1 and N can inform node i about their decision using a 
simple packet marking scheme, e.g., by using a flag in the packet header. Let y\ and z\ denote the 
rate at which source S\ sends data to node i marked for routing and network coding, respectively. 
Similarly, let y^ and z^ denote the data rate at which source sn sends data to node i marked for 
routing and network coding, respectively. Node i may jointly encode only those packets which 
are marked for network coding. If the packet is marked for routing, then node i simply forwards 
the packet without modifying its content. Furthermore, let v± and vn denote the data rates at 
which sources s\ and sn send remedy packets on side links (si,t N ) and (sjv,ti), respectively. 
The routing users 2, . . . , N — l just send routing packets at rates y 2 , ■ ■ ■ , Vn-i, respectively. 

Given the above data rates, intermediate node i encodes packets at rate mm(zi, zn) and 
forwards the rest of packets at rate J2n=i Vn^r \zi — %n\- As a result, the total rate on link 
becomes J2n=i Vn + max(«i, z N ). Let y = (y u . . . ,y N ), z = {z u z N ), and v = {v x ,v N ). For the 
butterfly network in Fig. |6j the network aggregate surplus maximization problem becomes 

Problem 3 (Surplus Maximization with Network Coding and Non-Zero-Cost Side Links): 



maximize } U n (y n ) + U x {y x + min(zi, v N )) + U N (y N + mm(z N , v x )) 

y,z,v ' ' 

n=2 

- C y n +max{zi, z N )j - Ci(t>i) - C N (v N ) 

subject to y n > 0, n — l,...,N, z±, z N , vi, v N > 0. 

We can see that the objective function in Problem [3] is more complex than the one in Problem 
2] and includes the cost of side links (si,tjv) and (sjy, ti). 



Following a discriminatory pricing model as in Section III-A we can define a resource 
allocation game for the network setting in Fig. [6j when users are price anticipators: 



Game 3: (Resource Allocation Game with Inter-session Network Coding and Routing Flows 
and Non-zero Costs for Side Links) 
• Players: Users in set M. 
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(27) 



(28) 



• Strategies: Transmission rates y, z, and v. 

• Payoffs: W n (-) for each user n G M, where 

Wi(yi, zx, vi] y_ x , z N , v N ) = U x (yi + min(zi, v N )) - t>iPi(t>i) 

- (yi + zi - (1 - f3) min(zi, z N )) p (j2^=i Vr + max(zi, z N 
W N (y N , z N ,v N ; y_ N , zx, v i) = U N (y N + min^, vx)) - v N p N (v N ) 

- (yN + Zn - (1 - /3) min(zi, z N ))p (j2r=i Vr + max(zi, z N ) J , 
W n (y n ;y_ n ) = U n (y n ) - y n p (Y^ =x y r +max(z 1 ,%)j , nejV\{l,iV}. (29) 

Here, for each user n G A/", we have y_ n = (2/1, . . . , j/ n -i> 2/n+i> • • • > 2/jv)- Next, we study the 
efficiency and the worst-case efficiency (i.e., the PoA) at Nash equilibria of Game [3j 

B. Users' Best Responses 

For network coding user 1, the best response is in form of (yf zjv, f/y), zf(y_ ll zn, vn), 
Vi(y_ 1 ,z N ,vj^)) which is obtained as the solution of the following optimization problem 

(Vx (V-i,zn,vn),z? (y_ u z N ,v N ),v x {y-x,z N ,v N )) = argmax W x (yi, z u vr, y_ x , z N , v N ). 

j/i>0, zi>0,»;i>0 

The best response for network coding user N, denoted by (y§(y_ N ,zi,v x ), z^(y_ N , z x , v x ), 
v N (y_N, z%, t>i)) is obtained similarly. We can show the following for users 1 and N. 

Proposition 3: Users 1 and N always send zero remedy packets at the best responses of Game 
[3] That is, we always have v 1 B (y_ l ,z N ,v N ) = and v§(y_ N ,z 1 ,vi) = 0. 

Proposition [3] can be proved by noticing that the payoff W x {yx, Zx, v x ; y_ x , zn, vn) is decreas- 
ing in vi and W N (y N , z N ,v N ;y_ N , z x ,vi) is decreasing in v N . Clearly, if the network coding 
users do not receive the remedy data from the side links, they cannot decode any encoded packet 
they may receive through the shared link In fact, we can further show the following. 

Proposition 4: Users 1 and iV always send zero network coding packets to intermediate node 
i as the best responses of Game [3} That is, zf {V-i,zn,vn) — and z N (y_ N ,Zi,v{) = 0. 

Notice that if = 0, then min(zi,Ujv) = and the payoff function for user 1 reduces to 
Ux [yx)-VxPx{vx) ~ (yi +zx - (1 - 0) mxn(zx, z N )) p(J2 r =x y r + ™-ax(zx, z N )). In that case, the 
payoff function is decreasing in z\. A similar statement is true for network coding user N. 
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C. Nash Equilibrium and Price-of- Anarchy 

Given the results on users' best responses in Propositions [3] and [4j we can conclude that at 
any Nash equilibrium of Game[3j denoted by (y*,z*,v*), we should indeed have 

z\ = z* N = v\ = v* N = 0. (30) 

In other words, at a Nash equilibrium of Game |3j none of the users perform network coding. 
In that case, the Nash equilibria of Game [3] would be closely related to the Nash equilibria of 
Game [TJ In fact, for any choice of system parameters, if x* is a Nash equilibrium of Game [TJ 
then y* = x*, z* = 0, and v* = would be a Nash equilibrium of Game [3] for the same choice 
of system parameters. From this, together with the results in Theorem [If a), we can conclude 
that Game [3] always has a unique Nash equilibrium. This leads to the following theorem. 

Theorem 9: The worst-case efficiency of Game [3] occurs when the utility functions are linear. 

The proof of Theorem [9] is similar to that of [8, Lemma 4]. From Theorem [9} to obtain 
the PoA for Game [3] for arbitrary choices of utility functions (as long as the utility functions 
satisfy Assumption [TJ, it is enough to only analyze the case where all utility functions are linear. 
Furthermore, we notice that if the side links have a very large cost compared to the cost of the 
bottleneck link, the optimal performance is achieved if network coding is not applied. In that 
case, the efficiency can be obtained by using Theorem [TJ Notice that in this case, the optimal 
network aggregate surplus for Problem [3] is the same as the optimal network aggregate surplus 
for Problem [TJ In addition, the network aggregate surplus is the same at the Nash equilibrium 
of Game [3] and Game[TJ However, for general choices of a\ > and > 0, obtaining the PoA 
requires further investigation of the optimal solution of Problem [3] 

Theorem 10: Let y s = (yf, . . . ,yff), z s = (zf,zfj), and v s = (vf,vff) denote the optimal 
solution for Problem [3j Assume that all utility functions are linear with slope 7„ for each user 
neM. Define 7 max = max neA r 7„ and M = {n : 7„ = 7 max } with size M — \M\. 
(a) If 7l + lN > (1 + 5i±2*) 7max , then 



Zl -Z N - Vl -u N - a + ai + aN , 



y? = Q, Wn G Af. (31) 



(b) If 7max < 7i + 77V < (1 + 7ma x , then 

+ IN - 7max s _ 

ai + a N n | o, if neN\M. 



I (a+ai+ajv)7max-a(7i+7iv) :f „ r- KA 
Z S_ Z S_ S _ V S _ ll+lN- 7max S _\ aM(a 1+ a N ) > HuEM, 

z i — z n — u i — u n — ; 5 yn — \ „ 
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(c) If 7 max > 7i + 7at, then 

I Tmax if /I ^ /M 

*f = 4 = *f = 4 = o, y s n = \ aM ' ; (33, 

0, \ineN\M. 

Recall that the linear pricing parameters a, oi, and a^r are defined in Assumptions [2] and [4j 
respectively. The proof of Theorem 10 is given in Appendix |IJ Combining (|30])-([33]) with the 



results in [8, Section II], we can show the following results on the efficiency loss in Game [3] 

Theorem 11: Consider a network coding system as in Fig. [6] and assume that N > 2. 

(a) We have 

PoA (Game Problem = -. (34) 



(b) The worst-case efficiency occurs when iV — > oo. 

The proof of Theorem 1 1 is given in Appendix [jj Here, PoA (Game Problem |3]) denotes 
the lowest (i.e., worst-case) ratio of the network surplus at a Nash equilibrium of Game [3] to 
the network surplus at the optimal solution of Problem [3] Comparing Theorem 11 and Theorem 



[8j we can see that a non-zero cost at the side links can further reduce the PoA in a network 
resource allocation game as the users do not perform network coding in this case. If the side link 
price parameters a\ and are significantly greater than the bottleneck link price parameter a, 
then network coding is not an optimal solution and the efficiency loss follows from the results 
in Theorem [TJ This is shown in Fig. |7J For the results in this figure, the network topology 
is assumed to be as in Fig. [6j where N — > oo, 71 = — 1, a — 1, and 7 n = § for all 
n E A/\{1, N}. The side link price parameters a\ = vary from {non-inclusive) to 10. If 
a\ > and > tend to zero, the efficiency becomes as low as | = 0.2 as Theorem [IT] 
suggests. As a\ = aw increases and tends to infinity, Problem [3] becomes equivalent to Problem[T] 
(in terms of the optimal network aggregate surplus) and Game [3] becomes equivalent to Game[T] 
(in terms of network aggregate surplus at Nash equilibrium) which leads to an efficiency higher 
than I w 0.67 as Theorem [T] suggests (for the choice of parameters in Fig. |7j the efficiency 
approaches | = 0.8). Numerical results on the efficiency of the Nash equilibrium of Game [3] for 
200 random scenarios with different choices of system parameters in the two-user case are also 
shown in Fig. [8] We can see that the simulations confirm Theorem 11 
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V. Conclusion 

This paper represents a first step towards understanding the impact of strategic network coding 
users on the network resource allocation efficiency. To gain insights, we focus on the case 
of the well-known butterfly network topology where there is a single bottleneck link in the 
network shared by several users. Two of the users have the capability of performing inter-session 
network coding, and the rest are routing only users. Even with this simple setup, the results are 
dramatically different from the traditional routing-only case. In particular, there can be many 
(even infinite) Nash equilibria in the resulting resource allocation game. This is in sharp contrast 
to a similar game setting with traditional packet forwarding where the Nash equilibrium is always 
unique. Furthermore, we showed that the efficiency loss can be significantly more severe than for 
the case without network coding. The precise values of the PoA and the efficiency loss depend 
on the pricing scheme used by the links. Compared with the traditional single pricing approach, 
a novel discriminatory pricing, which charges encoded and forwarded packets differently can 
improve efficiency. However, regardless of the discriminatory pricing scheme being used, the PoA 
is still worse than for the case when network coding is not applied. This implies that, although 
inter-session network coding can improve performance compared to routing, it is significantly 
more sensitive to users' strategic behaviors. For example, in a butterfly network when the side 
links have zero cost, the efficiency at certain Nash equilibria can be as low as 25%. If the side 
links have non-zero cost, then the efficiency at some Nash equilibria further reduces to only 
20%. These results generalize the well-known result of guaranteed 67% worst-case efficiency, 
shown by Johari and Tsitsiklis in [8] for traditional packet forwarding networks. This motivates 
our ongoing work of mechanism design to encourage the strategic users to perform network 
coding, e.g., by using a combination of reward and punishment in a dynamic game setting. 

Appendix 

A. Proof of Theorem [2] 

Let ) denote any arbitrary feasible solution for Problem [5] such that xi ^ x N . 

Without loss of generality, we assume that x 1 > x^- We then define x = (xi, . . . , x^) as another 
feasible solution such that x n = x n for all n G Af\{l, N} and x\ = xn = max(xi,Xjv) = x\. 
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Since for all users, the utility functions are strictly increasing in transmission rates, we have 

N N-l N-l N 

^2 U n{ X n) = ^ U ^( X n) + U N (x N ) > ^ U n{ X n) + U N (x N ) = ^ U n(x n ). (35) 
n=l n=l n=l n=l 

On the other hand, since max(xi,x^) = max(xi,x^), 

/N-l \ /N-l \ 

C J ^2 x n + max(xi, xn) J = C j x n + max(xi, xn) J • (36) 

\n=2 / \n=2 / 



From ( |35| ) and ( |36| ), the feasible solution i results in strictly higher network aggregate surplus 
compared to x. Thus, vector x cannot be an optimal solution for Problem |2j ■ 

B. Proof of Theorem [J] 

We prove the existence of Nash equilibrium for Game [2] by using Rosen's existence theorem 
for iV-person games [29, Theorem 1]. In this regard, we need to show that for each user n E M, 
the payoff function Q n is continuous and concave in data rate x n . This is not trivial, particularly 
for network coding users due to the complexity of the payoff functions. 

For user 1, given £c_x = (x 2 , ■ ■ ■ ,x~n), we can rewrite the payoff function Qi as 

, - . . ifxi<^, 
Qi(a?i;aj_i) = { (37) 

H^x^x^i), ifx 1 >x N , 



where 



and 



Gi(a:i; aj_i) = U x {xi) - (3x x p [J2n=2 x n + x n\ 



H 1 (X 1 ;X- 1 )=U 1 (X 1 ) - (xi-(l-P)x N )p (j2n=2 X n+Xlj ■ 

Clearly, Gi(xn; :c_i) = Hi(x N \ £C_i). That is, G\(xi; x-i) is continuous at x\ = xn- Thus, since 
Gi(xn, £E-i) and Hi(xn, £E-i) are also continuous functions, function Qi(xi,X-i) is continuous 
in x\. However, Qi(x\\ £C-i) may not always be differentiable. Next, we show that Qi(xi, cc_i) 
is concave. We need to show that for each x\ > and x\ > and for any < < 1, we have 

Qi(0£i + (1 - e)x x - x-x) > OQ^xi, x_i) + (1 - 0)Qi(x i; (38) 

Without loss of generality, we assume that xi<x%. We notice that if x\ < x\ < xn or xn < 



x\ < x\, then (38) is directly obtained from the fact that G\ and H\ are concave. Thus, we only 
consider the case where x\ < xn < X\. We consider two different scenarios for choice of 6: 

< e < XN ~ X \ (39) 

X\ — X\ 
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and 



X\ — X\ 



<9 <1. 



If (39) holds, then Qx\ + (1 — 6)x\ <x N . In addition, since X\ > x N , we have 

(1 — (3)x N < (1 — => (3xi <X\ — {\ — (3)x N , 



and 



'N-\ 



p ( x n + ^i ) > p i x n + 



.n=2 



,n=2 



From (41 ) and (42), we have 



Gi(xi) > Fa^). 



(40) 



(41) 



(42) 



(43) 



Therefore, 

Qi(0xi + (1 - 0)x±; sc_i) = + (1 - sc_i) 

> i; sc_i) + (1 - 0)G?i(5i; sc_i), 

= 0G 1 (z 1 ) + (l-0)Qi(5 1 ;a_ 1 ), (44) 

> OHxixx] x_0 + (1 - 0)Qi(£i; sc_i), 

= 6>Qi(xi; + (1 - 0)Qi(aci; sc-i), 

where the second line results from concavity of G\, the third line results from the fact that 
Q\(x\;x-\) = Gi(xi;x-i), the fourth line results from (43), and the fifth line is due to 
Qi(xi,X-i) = Hi(xi\x_i). Next assume that (40) holds. In that case, Qx\ + (1 — &)x\ > x N . 
In addition, since x\ < x N , we have 

(1 - f3)x N > (1 - p)x x Px x > x x - (1 - (3)x N , (45) 

and 



'N-l 



X n -(■ 



X N 



.n=2 



,n=2 



From (45) and (46), we have 



(46) 



(47) 



Therefore, we can show that 
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Qi(0£i + (1 



)xi, x-i) = Fi(0:ri + (1 - 6)xi, x-i) 

> OH^xu x- x ) + (1 - 0)#i(£i; sc_i), 
= 0Qx(x 1; sc_i) + (1 - 6)H 1 (xi; x_ x ), 

> 0Qi(xi; sB_i) + (1 - 0)Ci(xi; sc_i), 
= + (1 - d)Qi(xi; x-i). 



(48) 



From (44) and (48), payoff Qi(xi,a;_i) always satisfies (38). Thus, Q\{x\,X--\) is concave. 
Similarly, we can show that Qn(xn,x^n) is continuous and concave. The same statement is 
evidently true for all n 6 A/"\{1, iV}. Thus, Game[2]is a concave N-person game and the existence 
of Nash equilibria follows from the Rosen's existence theorem [29, Theorem 1]. ■ 

C. Proof of Proposition [7] 



For each user n&Af\{l, N}, the KKT optimality conditions for problem (10) become 

U'JXn) ~ a {Y,r=2,r^n X r + Zn+Hiax^i, X N )) - OLX n = -\ n , (49) 

and \ n x n = 0. Here, A n > denotes the Lagrange multiplier corresponding to inequality constraint 



x n > 0. If x n > 0, then A n = and (49) reduces to (11). Otherwise, (11) cannot hold for any 
positive x n and we have x n = 0. Recall that the best response is bounded below by zero. ■ 

D. Proof of Proposition [2] 



For user 1, we can write the KKT optimality conditions for optimization problem (12) as 

U'^Xi) - a(J2n=2 X n + Xl) ~ a { x l ~ (1 ~ P)x N ) = ~Ai, (50) 

and Ai (x\ — xn) = 0. Here, Ai > denotes the Lagrange multiplier corresponding to constraint 



%i > xn- If %i > %n, then Ai = and (50) reduces to (14). Otherwise, xi takes its lower bound 



value, i.e., x\ = xn- It is also easy to verify that (15) is simply the KKT condition for convex 



optimization problem (13), as long as the utility function Ui(xi) is non-linear (i.e., concave, but 
not linear). Therefore, it should hold for user l's best response data rate. If the utility function 



Ui(xi) is linear, then the objective function in optimization problem (13) becomes 



vM-l 

-2 x n ~r X N 



(51) 



where U[(xi) — f3a(J2n=2 x u + xn) is a constant. In this case, the best response depends on the 
sign of the multiplier term U[(x%) — Pa(^2^2 x n + x n) as explained in Proposition bl ■ 
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E. Proof of Theorem [?] 

At Nash equilibrium of Game [2| we have x^(x*_ n ) = x* for all users n G Af. From this, 



together with (11), (14), and (15) and also due to /3 < 1, we can show that 



Af /N~l \ 

J2KKK-C t^2x m n + max{xlx m N )\ > 0. (52) 

n=l \n=2 / 

That is, the network aggregate surplus is always non-negative at any Nash equilibrium of Game 
[2j On the other hand, using concavity of the utility functions, for each user neJ\f, we have 

U n (x s n ) < [/„«) + U' n (x* n ) (x s n - <) . (53) 

Again, by concavity, U n (0) < U n (x* n ) + £/"4(x*)(0 — x* n ). Since according to Assumption [T] 
U n (0) > 0, we have U' n (x* n )x* n < U n (x* n ). Applying this to all users n G M, we have 

Eli (U n (x* n ) - K(x* n )x* n ) > 0. (54) 

For notational simplicity, we define 

C*= C (£S x* n + max(xl, x*j) and C s = C x s n + max(xf , x* )) . (55) 

We notice that 

En =1 ^«)^ - C 5 = ES + (^l(^l) + U 'n(x*n)) Xf - C S 

< * (ES + max(xf , x* )) - C 5 (56) 

< max [aq — C(q)] , 

where g is an auxiliary variable, the equality results from Theorem [2| the first inequality is due to 



the definition of a, and the second inequality results from (55). Clearly, max,j>o [erg — C(q)) in 
( |56| ) provides an upper bound for the optimal network aggregate surplus when the utility functions 
are linear as in (16). First assume that a = U[(xl) + U' N (x* N ). In this case, if we select xf t = 



for all n G J\f\{l,N} and select xf = x% = q s , where q s = argmax= >0 [aq — C(q)}, then 
the network aggregate surplus reaches its upper bound maxg> [aq — C(q)]. Next, assume that 
a = U^x^) for some m G A/"\{1, N}. In that case, if we select x^ = for all n G J\f\{m} and 
select x^ = q s , then the network aggregate surplus reaches its upper bound maxg> [aq — C(q)]. 
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Therefore, we can conclude that max ? -> [aq — C(q)} is indeed equal to the optimal objective 
value of Problem[2]for the special case of having linear utility functions. Finally, from (|53|)-(56), 



1 > 



> 



> 



> 



2-m=l 


u n\X n ) 


— c* 












S~^N 
l^n=l 




_ c s 












sr^N 
2^n=l 




-K( 


X n) X n) + En=l 


K 


'rf*' 




- c* 








=1 U n (x n ) — C S 












(u n (x* n : 


-K 


y X n )x n ) + En=l 


K 




) X n 


-C* 


S~^N 
l^n=l 




-U' n ( 


+ En=l 




\ X n 


)X% 


-C s 


s-^N 


(UnK) 


-U' n ( 




K 




' X n 


-C* 



(57) 



£n=l (Un 



U' n {x* n )x* n ) + max 9 -> [aq - C(q)] 



En=l U n (x n )x n C 



> o, 



maxq> [aq - C(qj] 

where the third line results from ( [53] ), the fourth line results from ( [56] ), and the last line results 



from (52), (54), and (56) and also the fact that maxg> [aq — C(q)] is always non-negative. 



F. Proof of Theorem [6] 

We notice that since the utility functions are linear, we have: U' n {-) = 7„ for all n E W. Next, 
we prove that due to 71 > 7^, we should always have x\ > x* N . To show thus, assume that 
x\ < x* N . Since U[(xi) = 71, from Proposition [5J the inequality x\ < x* N implies that 

7i < Pa {q* + x* N ) . (58) 
Furthermore, since U' N (x N ) = from (14) and after reordering the terms, we have^] 

7at = aq* + 2ax* N — a(l — (3)x\. (59) 



From (58), (59), and due to 7^ < 71, it is required that 

aq* + 2ax* N — a(l — (3)x\ < f3a(q* + x* N ) 

=S> q*(l-(3)+x* N (2-f3)-(l-[3)x*<0. 



(60) 



If P = 1, then the inequality in (60) reduces to x* N < which contradicts the assumption that 
x* N > xl > 0. On the other hand, if < /? < 1, then we can further show that 



<f(l-P)+x* N (2-P)-(l-P)x\ > q*(l-P) + (x* N -x* 1 )(l-P) > 0, 



(61) 



3 Notice that 



14 1 in its current format is formulated for user 1; however, it can be reformulated similarly for user TV. 
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where the last (strict) inequality results from the assumption that x* N > x\. It is clear that (61 ) 



contradicts (60). Thus, for any < (3 < 1, the data rate x* N cannot be greater than x\ and we 
always have x* N < x\. Next, we prove each part of the theorem separately. 

Part (a): We first prove that x\ = x* N by contradiction. If x* ^ x* N , then since x\ > x* N , we 
should have x\ > x* N . In that case, from Proposition [2| 

7! - aq* + a(l - (3)x* N 



2a 



> x 



N 



7i > (1 + (3)ax* N + aq*, 



and 



From (62) and (63 ), 



JN < 

< f3aq* + 
This implies that 



In < f3ax\ + (3aq* . 

(71 - aq* + a(l - 
71 -ag +(1-/5)- 



(62) 



(63) 



1 + P 



(64) 



1 + 



(71 + (3aq*) 



1 + 



7iv - 



< 7i- 



(65) 



However, this contradicts the assumption in this scenario that 71 < (1 + 1//3) 7^ — /3ag*. Thus, 
we indeed have x\ = x* N . From this, together with Proposition |2j we have 

7i - aq* 



71 < f3ax\ + ag* 



aq* + (1 + /3)ax* 



and 



7Af 



> 



x 1 < 



a(l + /3) 

7at - /jag* 
/3a 



< ^1, 



(66) 



(67) 



Notice that the transmission rates are non-negative. Thus, the best responses are as in (20). 
Part (b): We first notice that the condition in this scenario holds if and only if 



1 + 



In 



aq 



In > (3aq*. 



(68) 



On the other hand, since 71 < |7a? — aq*, we have |7a? — 71 — aq* > and x* N in (21 ) is non- 
negative. Since x\ > x* N , this also implies non-negativity of x*. Next, we consider two cases: 

Case I) Assume that x* N > 0. Following similar steps as in the proof of Part (a), we can show 
that in this case, x\ > x* N . From this, together with Proposition [2j 

71 - aq* + a(l - (3)x* N 



2a 



(69) 
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and 



7tv = /3aq* + 3ax\ 



,}. I 



7iv - f3aq* 7^ 



Pa 



Replacing (70) in (69), we have 



In 



-q 



7i - aq* + a(l - 8)x% 



N 



X 



j3a 



In - 7i - aq 



f3a * 2a _JV a(l-/3) 

Case II) Assume that x* N = 0. In that case, from Proposition 2, we have 

7i - aq* 



2a 



and 



7jv < /3aq* + /?ax^. 



Replacing (72) in (73), we have 



3 daq* 



7i > -plN - aq*. 



From (74) and knowing that 7 X < |7jv — ag*, it is required that 



71 = -plN ~ aq 



By 



JN_ 

(3a 



(70) 



(71) 



(72) 



(73) 



(74) 



(75) 



Thus, in both Case I and Case II, the best responses are as in (21 ). 
Part (c): We consider two cases: 



Case I) Assume that x\ > x N . In that case, (62) and (63) hold. First, assume that 77V = 
(3aq* + (3ax\. Thus, x\ = j^ — q*- Replacing this in (62), the data rate for user iV is obtained as 



^=^: 71 : Qg <o, 



a(l-(3) 



(76) 



where the inequality results from the fact that 71 > |7at — aq*. Clearly, since the data rates are 



non-negative, the above implies that x* N = 0. Replacing this in (62), we have 

7i - aq* 



X-, 



2a 



Next, assume that (63) holds as a strict inequality. That is, 

7tv < [3aq* + 3ax\ =>- 



x 



N 



0. 



(77) 



(78) 



Replacing this in (62), the data rate model in (22) is obtained. 

Case II) Assume that x* = x* N . In that case, from Proposition |2j we have 

7i < (1 + (3)ax\ + aq*, 



(79) 
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and 



In > Paq* + (5ax\ 







7iv — aq* > aq* + 2ax\. 



From (79) and (80) and since by assumption > — aq*, it is required that 



[1 + (3)ax\ + aq* > aq* + 2ax\ 



a{l-(3)x\ < 0. 



Thus, either 



.1' 



A? 



and 71 = ag* or /3 = 1 and 71 = 2ax^ + ag* . In the latter case, 



7i - m 
2a 



In addition, from Proposition [2j we have 

71 - ag* + a(l - /3)x^ 



.1'-, 



2a 



(80) 



(81) 



(82) 



(83) 



From (82) and (83), x\ 



x 



N 



and 71 = aq*. Clearly, these results satisfy (22) 



Part (d): For each node n E A/"\{1, iV}, at each Nash equilibrium x* 6 <Y* of Game [2| it is 
required that x^(x*_ n ) = x* n . Thus, in case of having linear utility functions, the derivative of the 



objective function in problem (11) with respect to variable x n is obtained as 7 n — a (q* + x\)—x n a. 



If In < cl (<?* +x*) , the derivative is always non-positive and the objective function is decreasing 
in data rate x n . In that case, x* n = 0. Otherwise, i.e., if 7„ > a (q* + x*), then since the objective 
function is convex, we have x* 



111 
a 



q* — x*. Together, these two cases result in (23). 



G. Proof of Theorem [7] 

We first obtain the optimal solution of Problem [2] when N = 2. Since Problem [2] is convex, 
we can use the KKT optimality conditions and confirm that the optimal data rates are 



x 



s 



X 



s _ 7i + 72 



Thus, at optimality, the network aggregate surplus becomes 

s, s a i rs 5t\2 (71 + 72) 2 a/7i + 72 xi 
7izJ +7 2 x 2 - - {msx{x 1 ,x^}) = -I — — 



(71 + 72)^ 
2a 



(84) 



(85) 



Next, we examine the efficiency for all the scenarios in Theorem [6f a), (b), (c), where q* = as 
there is no routing user in the network. First, we assume that 

(86) 



72 < 71 < ( 1 + ~p ) "2- 



From Theorem |6f a), the Nash equilibria are as in ( [20] ). Since there are multiple Nash equilibria, 
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the worst-case efficiency for Game [2] is obtained by solving the following optimization problem 



minimize 



(7i + In) gj ~ pi 

(71 +72) 2 



* 2 



2« 



subiect to 7 — — < x-, < — . 

J (1 + P)a ~ 1 - pa 



(87) 



Problem ([87]) is a concave minimization (not maximization) problem. Thus, the optimality occurs 



at one of the boundary points. That is, either at x\ 



12, 
3a 



or at x 



71 



(l+B)a 



the objective function in Problem ( 87 ) with respect to x\ can be written as 

2a 



(7i + 72)' 



((71+72) - ax\) . 



The derivative of 



(88) 



The sign of the derivative in (88) depends on the choice of parameter p. We assume that 



I < (3 < 1. This includes the two cases of p = \ and /3 = 1. From (g), we have 

7i/3 > 7a(l - P) 



72 



7i +72 > -q > ax x , 



(89) 



where the last inequality is due to constraint x\ < ^ in (87). From (89), the derivative of the 



objective function in Problem (87) is positive. Thus, the objective function is increasing in x\ 
and the minimum occurs at lower-bound x\ = a (7+/3) • m tn ^ s case > tne efficiency ratio becomes 

7l \ 2 / 1 \ 1 / 1 \ 2 

-2 71+72-; 
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;i+/3) (7i+72)^ 



2(1 + /?) 









r 1 ) 




u +72/71 y 


(1+/5) 2 


U + 72/71/ 



For the ease of exposition, we define T 



1 



1+72/71 



Since 71 > 72, we have 



72 
7i 



< 1 



1 + — < 2 

7i 



1 + 72/71 



> 



r > 



On the other hand, from the lower and upper bounds in problem ( |87| ), we also have 

1 



1 



r < 



(90) 



(91) 



Tl - 1 + IjP ' ' ~ ~ 1 + 2p 
Thus, the worst-case efficiency is obtained by solving the following problem over variable T: 



minimize 

r 



l + P 



r 



;i+/3) : 



:T 2 



subject to - < T < — — 

J 2 - -1+2/3 

The derivative of the objective function in problem ( [92] ) can be obtained as 

2 2 _ 2 / r 

1 



(92) 



i+/3 (i+py 



i+p 



i+p 



(93) 
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On the other hand, we can show that 

l + p r . 1 



r < 



IP 



< 



1 + /3 ~ 1 + 2/3 



1 



r 



P 



> i 



i 



2P 



1 + 2/3 1 + 2/3 



> 0. (94) 



Thus, the derivative in (93 ) is always positive and minimum efficiency occurs at the lower bound 
r = |. Therefore, the worst-case efficiency when (86) holds is obtained as 



1 



1 



1 



1 



1 



1 + /3 



x 



If p = 1, then (95) becomes 



(1+/3) 2 4 1 + p 4(1 + /3) 2 ' 
1/2 - 1/16 = 7/16 « 0.438. 



On the other hand, if /3 = |, then (|95|) becomes 



Next, we assume that /3 < 1 and 



6/9 - 1/9 = 5/9 » 0.556. 



(l + l//3) 72 <7i < ^72- 



(95) 



(96) 



(97) 



(98) 



From Theorem |6j the data rates of users 1 and 2 at Nash equilibrium are as in (21 ) where q* = 0. 
Assuming that 72 is fixed, the worst-case efficiency is obtained by solving the following problem 



minimize 

71 



72 



(7i + 72) z 



2 4- 



P 1-/5 



7i + 



P\l-P P 



72 



(99) 



subject to (1 + 1//3) 72 < 7 i < -72- 



The derivative of the objective function in ( |99| ) can be obtained as 

1 



( 7 i + 72)' 



($ ( 7l _ 72 ) + 2 ^r) 



where 



$ = 2 72 



P 



P 



and 



1 



/3 



72 



(100) 



(101) 



If P = |, then $ = and \& = I272 2 . Thus, the derivative in ( 100) is negative and the minimum 
in (99) occurs at upper bound 71 = I72 = 4 72 . Replacing this in the objective function in (99), 



the worst-case efficiency when P — \ and (98) holds is obtained as 



12 72 2 12 72 2 



(4 72 + 7 2 ) 2 (57 2 ) 2 



12 

25 



0.48. 



(102) 
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Finally, we assume that 







72 < 7i. 



(103) 



From Theorem |6jc), the Nash equilibrium is as in (22) and the worst-case efficiency is obtained 
by solving the following optimization problem 



minimize 

7li72 



ry. 71 _ a (71 V 
l 1 2a 2 \2a) 

(7i +72) 2 
2a 



(104) 



subject to < —72 < 7i- 



The objective function in problem (T04J is decreasing in 72. Thus, the minimum occurs at 

irst-cas 

2 \2a) 



upper-bound 72 = §71. The worst-case efficiency when (103) holds is obtained as 



2a 



4 \l + P/2 



(2 + /?) 



2 • 



2<i 



If ft = 1, then ( 105 ) becomes 



(2 + 1} 



On the other hand, if /3 = |, then (105) becomes 



12 



0.33. 



0.48. 



(105) 



(106) 



(2 + |r 25 

Considering all the possible choices of system parameters, if pricing parameter (3 — 1, then 



(107) 



PoA (Game Problem |1 By =® min j — , - , 

and JT061 16 3 3 



On the other hand, if /3 — \, then 

PoA (Game O Problem gj) 
This concludes the proof. 



By (97), (T02l, . f 5 12 12 

^= — ' mm<-, — , — 
andJTOTl 19' 25' 25 



12 
25' 



(108) 



(109) 



H. Proof of Theorem [S] 

Using the KKT optimality conditions, the optimal network aggregate surplus, i.e., the optimal 
solution of Problem [I| for linear utilities is obtained as a 2 /(2a). Next, we study two cases: 

Case I) We assume that 71 + 7at = er. Similar to the proof of Theorem [7J here we obtain the 
PoA by examining all the scenarios in Theorem [6f a), (b), (c). First, assume that 

7tv < 7i < (1 + 1/P) In ~ Paq*, (110) 
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and 



7i > 

In that case, Nash equilibrium is obtained as in (|2"0"|). We notice that 



Byjp 7l _ aq * By ^ _ ^g* 

~~ a(l + /3) ~~ j3a 



(111) 



(112) 



To obtain the worst-case efficiency for this scenario, we need to solve the following problem 

^ + En=2 1 7n<-l(g*+^) 2 



minimize 
subject to 



a 2 /(2a) 
a (q* + x* n + x\) 



In 

In < a(q* + x\) 

vN-1 



if x* n > 0, n 
if x* = 0, n 



2. 
2. 



N-l, 



-2 X n 



7i + 7w 
7i > ag*, 
< 7n < cr, 



5 



iV- 1, 



7iv <7i < (l + l//3)7iv-/9ag* ) 



7i - aq 



< x* 



a(l + /3) 
xl > 0, n 



X N — 



7tv - /3ac/* 



(3a 



1,...,N. 



(113) 
(114) 
(115) 
(116) 
(117) 
(118) 
(119) 
(120) 
(121) 
(122) 



Here, 7 = (71, . . . , 7^) denotes the vector of utility parameters for all users. We assume, without 
loss of generality, that 7„ = a(q* + x* n + x\) for all users n E J\f\{l,N}. In fact, if for a 
feasible efficiency, we have x* n > for some n E J\f\{l,N}, then this assumption simply 
implies constraint (II 14h. On the other hand, if for a feasible efficiency, we have x* n = for 



some n E jV\{1, iV}, then assuming 7 n = a(q* + x* n + x\) does not have any impact on the 
objective function as the term 7„x* = 0, regardless of the value of 7„. Therefore, we can restrict 
our attention only to those feasible solutions for which we have 7 n = a(q* + x* n + x\) for 
all n — 2, . . . , N — 1. Having done so, to solve problem (|1 13[)-(fT2~2|), we first assume that all 



variables, except for x\ = xn, are fixed. The derivative of the objective function in (113) with 
respect to variable X\ is obtained as 

2a , 



<J- 



a(q* + xl)) . 



(123) 



33 



For any | < (5 < 1 and due to the fact that 7x > we have o" = 7i + 7jv > . By adding 
—a(q* + x*) to both sides of this inequality, we have 

ry By (TTTO) 

a-a{q*+x\) > ^- - a{q* + x\) ^0. (124) 



Therefore, the derivative in (123) is always non-negative and the worst-case efficiency occurs at 



lower bound x\ = x* N = . From this, together with ( 1 14), for each n = 2, . . . , N — 1, 



7„ = ax* n +a(q* = ax* n + a 



7i 



a(l+/3) 



ax„ + a 



7i 



a(l+/3) 



i * 

+ 9 



(125) 



Thus, the objective function in (113) becomes 

N-l 



2a 



a 



a(l+P) 



n=2 



71 



a(l+/3) * \l+/3 



P 



a / 7i 



" Xn ,X " 2Va(l+/3) ' * \l+P 



i =f 



P 



On the other hand, after reordering the terms, constraint (119) becomes 

° 7i ^* f P 



n ~ a a(l + P) 



Q 



l + P 



n = 2 N-l. 



(126) 



(127) 



The right hand side in (127) is non-negative. In fact, since a > 71 and due to (118), we have 



[a-'y 1 )+p{a-aq*)>Q a{l+P) > H+aPq* 



a 



> 



7i 



+q 



P 



. (128) 



a ~ a(l+P) * \l+P, 
Replacing ( |125[ ), ( |126[ ), and ( |127[ ) in problem ( |113[ )-( fT2~2| ), it reduces to the following problem 

2" 



minimize 



2a (7(71 — aq* 

y,a,N,cf a 2 a(l + P) 
N-l 

subject to V] x * n = 1*i 

n=2 

7i + In = 
7i > aq*\ 



N-l , 



a 



X,„ I 3^r, 



+/?) l+P n J n 2 \a(l+P) l+P 



71 + q*P 



0< 7n <a, n = 2,...,JV-l, 



In < 7i < ( 1 + ^ 1 In ~ Paq* 

P 



x„< 



7i 



a a(l + P) 



l + P 



xl > 0, 



n = 2,..., N- 1, 



n = 2,...,AT-l. 



(129) 

(130) 

(131) 
(132) 
(133) 
(134) 

(135) 
(136) 
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Problem ( 129[ )-( 136) is symmetric in ...,x* N . Therefore, the worst-case efficiency occurs 
when at Nash equilibrium we have 

q* 



X o X q 



x 



From (135) and (127), it is required that 



< 



a 



N-2 



7i 



x 



N-l 



N -2 



P 



N-2 ~ a a(l + P) * \1 + P 
By replacing (137) in (129), the objective function in (129) reduces to 

N-l 



(137) 



(138) 



2a 



a 



li-aq 
a(l+P) 



n=2 



Tl 



9 



a(l+P) 1+P N-2 J N-2 2\a(l+P) 1+P 



7i 



(139) 



The objective function in (139) is increasing in iV and constraint (138) becomes less restrictive 
as increases. Thus, the worst-case efficiency occurs as iV — ► oo. We also notice that 



N-l 



lim > 



n=2 



71 



q*P q* 
+ -r-—; + 



a(l + P) 1 + P N-2 J N-2 



aq 



7i 



+ 



a*P 



a(l + p) 1+pJ' 



(140) 



On the other hand, as N — > oo, constraint (138) becomes < - 



7i 



q*f3 



a o(l+/9) 1+/3 



. However, we 



already know that this constraint always holds as shown in (126). Thus, we can simply eliminate 
this constraint. By replacing ( 140[ ) in (139), the objective function becomes 



2a 



a 



7i ~ 
a(l + p) 



+ aq 



71 



+ 



q*P 



a(l + P) l + PJ 2\a(l + P) 1+P 



7i 



+ 



q*P 



(141) 



For notational simplicity, we define q* = aq*. After reordering the terms, (141) becomes 



a\l + P) 



7i<t 



7i 2 



+ q* 2 P [ 1 



2(1 + /?) 



P 



2(1 + /?) 



+ q 



-a + 7i 



1 + P 



(142) 



By looking at the remaining constraints, we can see that constraint (118) can be written as 

7i > q* > 0. (143) 



Given the definition of q* and by combining constraints (117) and (120), we also have 

a 1 + P P 2 q* 
— < 71 < o . 

2 - [1 - 1 + 2(3 1 + 2(3 



(144) 



Next, we take the derivative of the objective function in (142) with respect to 71 which yeilds 



o 2 (l + P) 



a 



71 q 



> 



1 + P 1 + p J - a 2 (l + P) 



a - 71 + 



Q 



1 + P 



> 0, 



(145) 



where the last inequality is due to a > j! and q* > 0. Since the derivative is non-negative, the 
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worst-case efficiency occurs at the lower bound of jx. Comparing constraints (143) and (144), 

a 



< 



li = Q. 



and 



a 



> Q 



7i 



a 
2" 



If (146) holds, problem (129 Ml 36) becomes 



minimize 

q* 



a 



a 



subject to — < q* < 



On the other hand, if (147) holds, problem ( 129 >-( 136 > becomes 



minimize — —. , 

r a 2 (l + (3) V8(l + /3) 

subject to < q* < ^ 



1 + 2(3 

2(1 + /?) "2(l+/3) 



a2 + r /?(2 + /3) 



(7- 



(146) 
(147) 

(148) 
(149) 

(150) 
(151) 



The objective function in (148) is increasing in q*, while the objective function in (150) is 
decreasing in q*. Thus, for both optimization problems ( 148 )-( [T4~9| ) and (150)-(151), the worst- 



case efficiency occurs at q* = |. Exploiting this in (148) and (150), the worst-case efficiency 
when 7i + 7at = cr and inequalities ( |110[ ) and ( |111| ) hold is obtained as 

1 /CT\2 1 



(152) 



Interestingly, the worst-case efficiency in this scenario does not depend on the choice of pricing 



parameter f3. Next, assume that condition (110) holds and we have 

ll < aq*. 



(153) 



From Theorem 



6^a), the Nash equilibria are obtained as < x\ 



* < IN-Paq* w show 
jv — pa 



that, in this scenario, the worst-case efficiency occurs if N — > oo and we have x\ 



x 



N 



and 



aq 



wrjrfiTt ■ Thus, the worst-case efficiency when (110) and (153) hold is obtained as 



2/32+4,3+3 



2/3 2 + 4/? + 3' 



(154) 



Details are omitted for brevity. Notice that if (5 = |, then (154) becomes ^- ps 0.36. 
Next, we assume that 



7at - 



< 7i < -plN - aq* 



(155) 
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From Theorem 6[b), at Nash equilibrium we have x* 



j^ — q and x 



N 



1(1-/9) 



Y^-g. We can 



show that the worst-case efficiency when (155) holds is again as in (154). Finally, we assume 



7i > -plN 

In that case, from Theorem 6 if 7 > aq* , then :r* 



aq 



1L 
2a 



■7^ and x*j^ 



(156) 

0. On the other hand, if 



j < aq*, then x\ 



x 



N 



0. In either case, the worst-case efficiency is still obtained as in (154) 



(157) 



Case II) We assume that 71 + 7iv < cr. Without loss of generality, we also assume that 72 = a. 
In that case, we can show that the worst-case efficiency in this scenario becomes 

2 

3 ~ ° 67 - 

In fact, the results in this case are similar to the results in Theorem [T] (see [8, Theorem 3]). 
Combining the results from Case I and Case II, if pricing parameter @ — 1, then 

12 2' 



PoA (Game Problem ® By ^ m 

and l |157| 



mm 



On the other hand, if (3 



|, then 



PoA (Game Problem 0) By ^ m 

and |l57]l 



mm 



4' 9' 3 



14 2 
4' IT' 3 



2 
9' 

1 

: 4' 



(158) 



(159) 



This concludes the proof. 



/. Proof of Theorem [77j| 

We first notice that at optimality, we always have zf = z^ = vf = vfj. This can be easily 
proved by contradiction. Therefore, we can rewrite the objective function of Problem [3] as 



N 



a l + &N 9 

— 7; — z l 



n=l 




(160) 



The above objective function is concave in y 1 , . . . ,y N . Using KKT optimality conditions, we 
can show that for each n 6 J\f\M we have = and for each n G M, we have 

1 /Tmax _ S\ if Tmax > S 

M \ a 1 / ' a — 1' (161) 

0, otherwise. 
Part (a): Examining both cases > 24 and < z b we can show that optimality occurs if 



Vn 



< z\. In that case, y% = for all n E M and the objective function in (160) becomes 



. . a + ai + ajv 2 
zi (71 + In) o zi , 



(162) 
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7l+7iV 



which is concave in z\. Thus, at optimality, we have z\ n+in _ s _ < ■ 
Part (b): We can show that in this case, optimality occurs when lms ^ > z\. Replacing (161 ) in 



(160), the objective function becomes 

z\ (71 + 7iV 7maxJ 

which is concave in z\. Thus, 



a 1 + a N 2 7, 

o z l + 



2a 



7i + In ~ 7 



(163) 



(164) 



By replacing ( |164[ ) in ( |161[ ), the data rates in ( [32] ) are resulted. 

Part (c): Again, we can show that in this case, optimality occurs when > z\. The objective 



function is the same as that in (163). However, since 71 + 7tv < 7max, at optimality we have 
zf = 0. Replacing this in (161 ), the data rates in (33) are obtained. ■ 



J. Proof of Theorem 1 1 



From ( [30] ), and given the payoff functions in Game [3j for each user n E ftf, we have 

(in - a J2r=l,r^n Vr) I ( 2fl )' if 7n > O Yfr=\,r+n Vr, 

First assume that 

. A . ax + a N \ 

ll+lN> H 7max- 



(165) 



(166) 



In that case, from (31), the maximum network aggregate surplus becomes (71 + ■y N ) 2 /(2(a + 
a x + a N )). The worst-case efficiency is obtained by solving the following optimization problem 

ry y* _ " *2 



minimize 

y*,~/,a,a 1 ,a N ,N,q* 

subject to 



(7i+7Af) 2 
2(a+ai+a]v) 

7„ = aq* + ay* n , if y n > 0, 71= 1, 
7n < ag*, if y„ = 0, n = 1, 



e;=i = 9* > o. 

^ 7n ^ 7max; 



71 = 1, . . . , N, 



7l + 7^ > H 7max, 



AT. 



y* n > 0, 71 = 1, 
a, ai, a^v > 0. 



(167) 

(168) 
(169) 
(170) 
(171) 
(172) 
(173) 
(174) 
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Since the objective function in (167) is increasing in a\ > and a N > 0, the minimum occurs 
if ai^O and a at— »0. We can also assume, without loss of generality, that 7„ = aq* + ay* n for 
each ne M. By replacing ( |168[ ) in ( |167| ), ( |171| ), and fl!72) >, problem ( |167[ )-( |174[ ) becomes 

... 2a / . . , \ -v , ., „ a 



minimize 



subject to y* = g* - - j& > 



(q*+yl)yl+a(q*+y%)y* N + J2 a ^+yn)y:-^* 2 ) (175) 



7n 



o<y;< 

aq* < 7max, 

g* > yl + y* N , 
2g* + y{ + y* N > 

a > 0. 



7n 



n=2 



,N, 



(176) 
(177) 
(178) 
(179) 
(180) 
(181) 



Problem ( 175 )-( 18 1 ) is symmetric in y%, . . . , 2/iv-i- Thus, the worst-case efficiency occurs if 

<f -yl~ y* N 



y 2 = % 



— 2/jV-l 



iV-2 



(182) 



Furthermore, problem ( 175[ )-( T8~Tj ) is decreasing in N. Thus, the worst-case efficiency occurs 



when N — > oo. From this, together with (182), optimization problem ( 175 )-( 1 8 1 ) reduces to 



minimize 

yl,y* N ,o,,q* 



m 2 + yj + V) 

(2q* + y*,+ y* N f 



subject to yl + y* N < q* < 

2g* + yl + y* N > 



7n 



a 

7max 



(183) 

(184) 
(185) 



Problem (183 )-( 185 ) is symmetric in y x and y N . In fact, we can show that the worst-case efficiency 



occurs at y* 



Vn 



Replacing this in the objective function in (183), the worst-case 



efficiency when (166) holds is obtained as 



,' 2 x „■ 
2 ' 16 



5\2 
2/ 



1 

5" 



(186) 



We can also show that if 7 max < 71 + 7tv < (l + ^f^) 7max or 7 max > 71 + 7^, then the 
worst-case efficiency is equal or higher (i.e., better) than |. In particular, if 7 max > 71 + 7tv, 
then the worst-case efficiency is | which resembles the results in [8]. Details are omitted here 
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for brevity. In summary, we have 



PoA (Game H Problem |3) 



By fl86) 



mm 




5 



1 



(187) 



This concludes the proof. 
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TABLE I 

Summary of the key results in this paper and comparison with 
related state-of-the-art results without considering network coding in [8]. 



Networking 
Setting 


Routing 
Only 


Network Coding and Routing 
with Zero Side Link Costs 


Network Coding and Routing 
with Non-zero Side Link Costs 


Optimization 


Problem [l] 


Problem Q 


Problem [3] 


Game 


Game[l] 


Gamej^J 


Game [3] 


Number of 

Nash 
Equilibria 


One (Unique) 


Can be infinite 


One (Unique) 


Price-of 
Anarchy' 
(PoA) 


2 
3 


1 

4 


1 

5 


Theorem 


Theorem jlj 


Theorem Jsj 


Theorem 11 


Reference 


[8] 


This Paper 



t Here, the PoA for the network coding scenario with zero side link costs is calculated based on 
the assumption that we use price discrimination with parameter f3 = 0.5. If single pricing is used, 
i.e., if P = 1, then the PoA can be less (i.e., worse) than |, as discussed in Theorem 7 
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TABLE II 
List of Key Notations 



PoA(Game CI, Problem fl) 


Price-of-anarchy for Game f2 with respect to Problem f2, where SI = 1, 2, 3. 


N 


Set of all users in the network. 


N 


Number of all users in the network. 




Transmitter and receiver nodes of user n £ N, respectively. 


(m) 


Shared bottleneck link between intermediate nodes i and j. 




Data rate of user n £ N in the networks in Figs. 


1 


and 


2 




X — n 


Vector of data rates of all users other than user n in the networks in Figs. 


1 and 2 


X 


Vector of data rates of all users in the networks in Figs. 


1 


and 2 


£4(0 


Utility function of user n £ A/". 


In 


Slope of linear utility function of user n £ N . 


C{.) 


Cost function of shared bottleneck link 


p(0 


Price function of shared bottleneck link 


a 


Price parameter, p(q) — aq. 




Price value for routed packets. 


5 


Price value for network coded packets. 


P 


Price discrimination parameter. 


Pn 


Payoff function of user n £ N in Game 


1 




Q n 


Payoff function of user n £ N in Game 


2 




x s 


Optimal solution for Problems 


1 and 


2 


X* 


Nash equilibrium for Games 1 


and 2 






Best response data rate for user n £ N in Games 


1 


and 


2 




Xi, Xn 


Packets/symbols sent from source nodes si and sm, respectively. 


X x ®X N 


Packet/symbol obtained by joint encoding of packets/symbols X\ and Ajv. 


C\(-),C N (-) 


Cost functions of side links (si,tjv) and (sjv,£i) in the network in Fig. 


6 




Pi(-). Pjv(-) 


Price functions of side links (si,tjv) an d (sjv,£i) in the network in Fig 


6 




Ol> a iV 


Price parameters, pi(q) = aig and pjv(g) = ajvg. 




Data rate for routed packets of user n £ N in the network in Fig. 6 




Zl, ZjV 


Data rate for encoded packets of users 1 and N on link in the network in Fig. 6 




«1,WJV 


Data rate for remedy packets of users 1 and iV on the side links in the network in Fig. 


6 




Vector of data rates for routed packets of all users other than user n in the network in Fig. 6 




Payoff function of user n £ N in Game 


3 






Optimal solution for Problem 


3 




Nash equilibrium for Game 3 








Best response data rate for routed packets of user n £ N in Game 


3 




*f (•).*£(•) 


Best response data rate for encoded packets of users 1 and TV in Game '. 




»f (•)>«#(•) 


Best response data rate for remedy packets of users 1 and N in Game 3 
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Fig. 1. A single wireline bottleneck link shared by N routing flows [8], Transmission of packets over bottleneck link at each 
unit of data rate incurs at cost of C(X^=i x n) an d imposes price p(X} n =l Xn )- Elastic data rates xi, . . . , xn are selected by 
users 1, . . . , N, respectively. 




Fig. 2. A butterfly network (cf. [5], [26]) with a single bottleneck link shared by N flows from N users and two side links. 
Transmission of packets over bottleneck link at each unit of data rate incurs at cost of C \^2n=2 Xn + max ( I i, I iv)j and 
imposes a price p yY^Z? x n + max(a;i, Xn)j . Since the source node si of user 1 is located closer to the destination node 
tjv of user (and vice versa), users 1 and N can jointly perform inter-session network coding and reduce the traffic load on 
the shared bottleneck link (and reduce cost C). The side links (si,tjv) and (sjv,ii) are assumed to be free of charge in 
this setting. Here, x\ and xn denote the data rates of source nodes s\ and sjv, respectively. On the other hand, Xi and Xn 
denote the actual packets/symbols sent from nodes si and sjv, respectively. The notation X\ © Xn indicates a network coded 
packet/symbol obtained by jointly encoding packets X\ and Xn- 



44 



(a) p = 1 

7 i , , 



.3 6 - 




_1 1 i i i i 

1 2 3 4 5 6 

Utility Parameter y 

(b) (3 = 0.5 

7 I , 1 — , r- -1 




_1 I i 1 1 i 

1 2 3 4 5 6 

Utility Parameter y 



Fig. 3. Nash equilibria for the resource allocation game in Fig. 2, i.e., Game [2] when there are N = 2 (network coding) users: 
(a) Without price discrimination, i.e., (3 = 1, (b) With price discrimination when (3 = h. The rest of the parameters are as 
follows: a = 1, 71 > 72, and 72 = 1. If 71 and 72 are close (e.g., 72 < 71 < 272 for (3=1 and 72 < 71 < 372 for (3 = |), 
there are multiple Nash equilibria as indicated by the shaded area, following the model in l |20| l with q* = 0. For example, if 
(3 = I and 71 = 72 = 1, then any choice of data rates x* = between | and 2 is a Nash equilibrium. Therefore, in this 
case, there is an infinite number of Nash equilibria. Recall from Theorem[T|a) that in Game[TJ i.e., the resource allocation with 
routing-only users, the Nash equilibrium is unique. This is one of the key differences between Game [T] and Game [2] 
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0.3 
0.2 
0.1 




* Efficiency at Nash Equilibrium of Game 2, (3 = 1 
O Efficiency at Nash Equilibrium of Game 2, (3 = 0.5 

PoA(Game 2, Problem 2), p = 1 

- PoA(Game 2, Problem 2), (3 = 0.5 



I 20 40 60 80 100 120 140 160 180 200 
Scenario Number 



Fig. 4. Efficiency at a Nash equilibrium of 200 randomly generated resource allocation game scenarios when the network 
topology is as in Fig. [2] and the number of users N = 2. Notice that for each scenario, the efficiency is obtained as the ratio of 
the network aggregate surplus at Nash equilibrium of Game [2] and the network aggregate surplus at optimal solution of Problem 
|5] Here, we set either /3 = 1 or /3 = |, where f3 is the price discriminating parameter. For each scenario, the pricing parameter 
a £ (0, 10) is selected randomly. The utility functions Ui and U2 are chosen to be a-fair (cf. [23]) with randomly selected 
choices of utility parameter a G (0, 1). Note that the PoA is defined as the worst-case efficiency. We can see that if /3 = 1, the 
PoA is equal to | « 0.33. On the other hand, if /3 = |, then the PoA is equal to || = 0.48. These results confirm Theorem IT] 
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Fig. 5. Nash equilibria for the resource allocation game in Fig. [2] when N = 3, a = 1, j3 = |, 71 > 73, 73 = 1, and 72 = 3. 
Users 1 and 3 jointly perform inter-session network coding and user 2 is a routing user: (a) Transmission rates for users 1 and 
3, (b) Transmission rates for user 2. If 71 < 2, then 72 > 71 + 73. In that case, at optimality of Problem [2] link should 
only carry the packets from routing user 2. If 71 > 2, then 72 < 71 + 73. In that case, at optimality, link should only 

carry the packets from network coding users 1 and 3. 
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Cost: C N , Price: p N 



Fig. 6. A single link shared by N flows. Users 1 and N perform inter-session network coding. The side links (si,tjv) 
and (sN,ti) have non-zero cost. Thus, users 1 and N need to pay for their transmissions over links (si,£jv) and (sjv,ii), 
respectively. Here, y\ and Z\ denote the data rate at which source s\ sends data to intermediate node i marked for routing and 
network coding, respectively. Similarly, j/jv and zm denote the data rate at which source sjv sends data to node i marked for 
routing and network coding, respectively. Node i jointly encodes only those packets which are marked for network coding. On 
the other hand, v\ and vn denote the data rates at which sources si and sjv send remedy packets over side links (si,tjv) and 
(sjv, ti), respectively. The routing users 2, . . . , N — 1 send packets to node i all marked for routing with rates 1/2, ... , Un-i, 
respectively. Notation Xi © Xm indicates a network coded packet/symbol obtained by jointly encoding packets Xi and Xn- 
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Fig. 7. Efficiency at Nash equilibrium of Game [3] when the network topology is as in Fig. [6] and we have: N — > oo, 
7i = 7jv = 1, 7n = | for all n G 7V\{1, AT}, and a = 1. Side link price parameters ai = ajv vary from (non-inclusive) to 
10. Notice that for each choice of parameters ai = ajv, the efficiency is obtained as the ratio of the network surplus at Nash 
equilibrium of Game [3] and the network surplus at optimal solution of Problem [5] We can see that the worst-case efficiency in 
this case is equal to |, as expected from Theorem [TT| As the prices on the side links increase, network coding becomes less 
beneficial and the efficiency increases to a value (in this case | = 0.8) which is higher than |, as expected from Theorem[T| 
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Fig. 8. Efficiency at Nash equilibrium of 200 randomly generated resource allocation game scenarios when the network 
topology is as in Fig. [6] and where N = 2. For each scenario, the pricing parameters a G (0, 10), a± £ (0,5), and 02 € (0,5) 
are selected randomly. The utility functions Ui and U2 are chosen to be a-fair (cf. [23]) with randomly selected choices of 
utility parameter a £ (0, 1). Note that the PoA is defined as the worst-case efficiency. We can see that the efficiency of Game 
[3] is always lower bounded by | = 0.2, i.e., the PoA is |, as expected from Theorem 1 1 1 1 



